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Abstract — We derive a variant of the nonsmooth maximum 
principle for problems with pure state constraints. The interest 
of our result resides on the nonsmoothness itself since, when 
applied to smooth problems, it coincides with known results. 
Remarkably, in the normal form, our result has the special 
feature of being a sufficient optimality condition for linear- 
convex problems, a feature that the classical Pontryagin max- 
imum principle had whereas the nonsmooth version had not. 
This work is distinct to previous work in the literature since, for 
state constrained problems, we add the Weierstrass conditions 
to adjoint inclusions using the joint subdifferentials with respect 
to the state and the control. Our proofs use old techniques 
developed in [16], while appealing to new results in [7]. 

I. INTRODUCTION 

It is commonly accepted that optimal control appears with 
the publication of the seminal book [14] where the statement 
and proof of the Pontryagin Maximum Principle played a 
crucial role (we refer the reader to the survey [13] for an 
interesting historic account of the pioneering results). Since 
then we have witnessed continuous developments. 

Generalization of the classical maximum principle to prob- 
lems with nonsmooth data appeared in 1970's as mainly the 
result of the work of Francis Clarke (see [3] and references 
therein). The nonsmooth maximum principle, nowadays a 
well established result, was then extended and refined by a 
number of authors. One of the first attempts to extend it to 
cover problems with state constraints came up in [16]. 

A special feature of the classical Pontryagin maximum 
principle is that it is also a sufficient optimality condition 
for the normal form of the so called linear-convex problems. 
Regrettably, the nonsmooth version had no such feature. 
Nonsmooth necessary optimality conditions in the vein of 
maximum principles were proposed in [8] overcoming this 
setback. Regrettably those necessary conditions did not in- 
clude the Weierstrass condition responsible for the very name 
Maximum Principle. More recently the setbacks in [8] were 
taken care of in [6] where a new variant of the nonsmooth 
maximum principle is derived by appealing to [5]. As in [8], 
Lipschitz continuity of dynamics with respect to both state 
and control is assumed, the special ingredient responsible 
for sufficiency of the nonsmooth maximum principle when 

This work has been supported by the European Union Seventh Framework 
Programme [FP7-PEOPLE-2010-ITN] under grant agreement n264735- 
SADCO. The first author is supported by the grant SFRH/BD/63707/2009, 
FCT, Portugal. 

Haider Ali Biswas is with ISR and DEEC, Faculdade de Engenharia da 
Universidade do Porto, Rua Dr. Roberto Frias , 4200-465 Porto, Portugal 
dee08022@fe.up.pt 

Maria do Rosario de Pinho is with ISR and DEEC, Faculdade de 
Engenharia da Universidade do Porto, Rua Dr. Roberto Frias , 4200-465 
Porto, Portugal mrpinhoS f e . up . pt 



applied to normal linear convex problems (see problem (LC) 
below) Q. In what follows, and for simplicity, we opt to refer 
to the statement of this new nonsmooth maximum principle 
stated as Theorem 3.1 in [7] which plays a crucial role in 
our developments. 

Here we extend Theorem 3.1 in [7] to cover state con- 
strained problems. In doing so we follow closely the ap- 
proach of [9] and [10] where the main result in [8] is 
generalized to cover state constrained problems in two steps; 
first the convex case is treated in [9] using techniques based 
on [16] and then convexity is removed in [10]. 

In this paper we show that the proofs in [9] and [10] 
adapted easily to allow extension of Theorem 3.1 in [7] to 
state constrained problems. In this way we obtain a new 
variant of the nonsmooth maximum principle, improving on 
[10] by adding the Weierstrass condition to the previous 
conditions while keeping the interesting feature of being a 
sufficient condition for normal linear-convex problems. 



II. PRELIMINARIES 



A. Notation 



x 6 A} . 
IP) if and 



) iff it is 



Here and throughout B represents the closed unit ball 
centered at the origin regardless of the dimension of the 
underlying space and | • | represents the Euclidean norm or 
the induced matrix norm on M. px<? . The Euclidean distance 
function with respect to a given set A C M. k is 

d A :R k ^R, y^d A (y) = inf {\y - x\ 

A function h: [0, 1] ->■ W lies in W 1 ' 1 ^, 1] 
only if it is absolutely continuous; in i 1 ([0, 1]; 
integrable; and in L°°([0, 1]; M. p ) iff it is essentially bounded. 
The norm of i 1 ([0, 1];R P ) is denoted by and the norm 
of L°°([0, 1]; MP) is ll-IU. 

We make use of standard concepts from nonsmooth anal- 
ysis. Let A C M k be a closed set with x £ A. The limiting 
normal cone to A at x is denoted by Na(x). 

Given a lower semicontinuous function f : M k — > RU 
{+00} and a point x £ M k where f(x) < +00, df(x) 
denotes the limiting subdifferential of / at x. When the 
function / is Lipschitz continuous near x, the convex hull 
of the limiting subdifferential, co df(x), coincides with the 
(Clarke) subdifferential. Properties of Clarke's subdifferen- 
tials (upper semi-continuity, sum rules, etc.), can be found 
in [4]. For details on such nonsmooth analysis concepts, see 
[4], [15], [17] and [12]. 

1 With respect to generalizations of [8] we also refer the reader to a 
different version of a nonsmooth maximum principle in [1] making use of 
"compatible" feedback controls. 



B. The Problem 

Consider the problem denoted throughout by (P) of 
minimizing 

l(x(a),x(b))+ f L(t,x(t),u(t)) dt 

J a 

subject to the differential equation 

x(t) = f(t,x(t),u(t)) a.e. te[a,b], 

the state constraint 

h(t,x(t)) ^ for all t e [a, b], 

the boundary conditions 

(x(a),x(b))eC, 

and the control constraints 

u{t)eU(t) a.e. te[a,b]. 

Here the interval [a, b] is fixed. We have the state x(t) € 
R™ and the control u(t) £ R fc . The function describing the 
dynamics is / : [a, 6] xR" xR fe — > R™. Moreover h and L are 
scalar functions h : [a, b] x R" -> R, L : [a, 6] x R" xR l 4 
R, t/ is a multifunction and Ccl°x R™. 

We shall denote by (S) the problem one obtains from (P) 
in the absence of the state constraint h(t, x(t)) ^ and we 
refer to it as a standard optimal control problem. 

Throughout this paper we assume that the following basic 
assumptions are in force: 

Bl the functions L and / are C x £>-measurable, 
B2 the multifunction U has C x S-measurable graph, 
B3 the set C is closed and / is locally Lipschitz. 

For (P) (or (S)) a pair (x, u) comprising an absolutely 
continuous function x, the state, and a measurable function 
u, the control, is called an admissible process if it satisfies 
all the constraints. 

An admissible process (x*,u*) is a strong local minimum 
of (P) (or (S)) if there exists e > such that (x*,u*) 
minimizes the cost over all admissible processes (x, u) such 
that 

\x{t) -x*(t)\ <e for all* e [a,b]. (1) 

It is a local W 1,1 -minimum if there exists some e > such 
that it minimizes the cost to all processes (x, u) satisfying 
(|TJ and 




\x(t)-x*(t)\ dt^e. 



Let R : [a, b] — >]0, +oo] be a given measurable function. 
Then the admissible process (x*,u*) is a local minimum 
of radius R if it minimizes the cost over all admissible 
processes (x, u) such that 

\x(t)-x*(t)\^e, \u{i) -u*(t)\ < R(t) a.e. 
and I \x(t) - x*{t)\ dt ^ e 

J a 

for some e > 0. 



C. Assumptions 

In what follows the pair (x*,u*) will always denote the 
solution of the optimal control problem under consideration. 

Let us take any function </> defined in [a, b] x R" x R fc and 
taking values in R™ or R. 

Al There exist constants fc* and fcf for almost every t <S 
[a, b] and every (xi,u.i) (i = 1,2) such that 

Xi e {x : \x - x*(t)\ < e}, it, e f/(t) 

we have 

|^(t,xi,ui)-0(t,X2,w 2 )| < k$\xi-x 2 \+k£\ui-u 2 \- 

A2 The set valued function t U(t) is closed valued and 
there exists a constant c > such that for almost every 
f e [a,b] we have 

|u(t)|<c VueU(t). 

When Al is imposed on / and/or L, then the Lipschitz 
constants are denoted by k[, k[, k% and k^. Observe 
that if U is independent of time, then A2 states that the 
set U is compact. Assumption A2 requires the controls 
to be bounded, a strong hypothesis but nevertheless quite 
common in applications. It also simplifies the proofs of the 
forthcoming results where limits of sequence of controls 
needed to be taken. 

D. Auxiliary Results 

Attention now goes to problem (5), i.e., we assume 
that the state constraint is now absent. We next state an 
adaptation of Theorem 3.1 in [7] essential to our analysis 
in the forthcoming sections. It is "an adaptation" because it 
holds under stronger assumptions than those in [7]. 

Theorem 2.1: Let (x* , u*) be a strong local minimum for 
problem (S). If BI-B3 are satisfied, f and L satisfy Al and 
U is closed valued, then there exist p £ W 1 ' 1 ^, b]; R n ) and 
a scalar Ao ^ satisfying the nontriviality condition [NT]: 

Iblloo + A > 0, 
the Euler adjoint inclusion [EI]: 

(-p(t),0)€dg u [(p,f)-X L)(t,x*(t),u*(t)) 
-{0}xK\p(t)\dSd u(t) (u*(t)) a.e., 

the global Weierstrass condition [W]: 

V u e U(t), 

(p(t), f(t, x* (t), u)) + X L{t, x*(t), u) ^ 
&(t)J(t,x*{t),u*(t)))+\ L{t,x*{t),u*(t)) a.e., 

and the transversality condition [T]: 

(p(a),-p(b)) € NS(x*(a),x*(b)) + X d L l(x*(a),x*(b)). 

In the above K is a constant depending merely on k[, k^, 
k{ and 

In [7] the analysis is done for local minimum of radius 
R instead of strong minimum and it holds under a weaker 
assumption than Al. 



We point out that the conditions given by the classical 
nonsmmoth maximum principle (see [5]) are [NT], [W], [T] 
and [EI] is replaced by 

-m g (2) 

% (<P(*), /(*. (*), «* («))) - W, x*(t),u* (t))) . 
We refer the reader to [6] for a discussion on (|2) and [EI]. 

III. MAIN RESULTS 
We now turn to problem (P). We derive a new nonsmooth 
maximum principle for this state constrained problem in the 
vein of Theorem 3.1 in [7] in two stages. Firstly the result 
is established under a convexity assumption on the "velocity 
set" (see C below). Then such hypothesis is removed. This 
is proved following an approach in [17] and similar to what 
is done in [10]. 

On h we impose the following: 

A3 For all x such that \x(t) — x*(t)\ ^ e the function 
t —> h(t, x) is continuous. Furthermore, there exists a 
constant kh > such that the function x —> h(t,x) is 
Lipschitz of rank kh for all t € [a, b]. 

The need to impose continuity of t — > h instead of merely 

semi upper continuity is discussed in [9]. 

Recall that our basic assumptions B1-B3 are in force. 

Suppose that / and L satisfy Al and that A2 holds. For 

future use, observe that these assumptions also assert that 

following conditions are satisfied: 

\cj>(t,x*(t),u)-cl>(t,x*(t),u*(t))\ < (3) 
kt\u - u*(t)\ for all u G U(t) a.e. t 

and there exists an integrable function k such that 

\4>(t,x*(t),u)\ < k(t) for all u G U(t) a.e. t. (4) 

In the above <j> is to be replaced by / and L. Moreover, 
it is a simple matter to see that the sets f(t,x,U(t)) and 
L(t, x, U(t)) are compact for all x G x* (t) + eB. 

A. Convex Case 

Consider the additional assumption on the "velocity set": 
C The velocity set 

{(«,/) - {f{t,x,u),L(t,x,u)), ueU(t)} 

is convex for all (t, x) G [a, b] x M™. 

Introduce the following subdifferential 

B x h(t,x):= (5) 
co{lim^ : ^ G d x h(U, x t ), (U, xj) -> (t, x)}. 

Proposition 1: Let (x*,U*) be a strong local minimum 
for problem (P). Assume that f and L satisfy Al, assump- 
tions B1-B3, A2 and C hold and h satisfies A3. 77ie« there 
exist p <G W 1 ' 1 ^, b];R n ), 7 € L 1 ([a,b];R), a measure 
[i € C®([a, b]; R), and a scalar Ao ^ satisfying 

(i) ^{[o,6]} + ||p|| oo + A >0 J 



(ii) (-p(t),0) G 

C ((g(t), /(*, (*),u* (*))) - Aoi(t,a:*(t), «•(*))) 

-{°}x^(t)( u *W) 

(iii) V«e I7(t), 
(q(t),f(t,x*(t),u))-\ L(t,x*(i),u) ^ 
{q(t),f(t,x*{t),u*(t))) - Aoi(t,i*(t),«*(t)) 

(iv) (p(a),-g(6))G 

N£(x*(a), x*(b)) + \ dl{x*{a), x*{b)), 

(v) 7(4) G Bh(t,x*(t)) [i-a.e., 

(vi) supp{^} c{te [a, 6] : x*(<)) = 0} , 
w/zere 

f P(*) + L t) T(s)M(ds) i G [a, 6) 

g(t) = { (6) 

I + I[a,b] 7(«)M(d») < = 

B. Maximum Principle in the Nonconvex Case 

Now we replace the subdifferential by a more refined 
subdifferential d> h defined by 

8>h(t, x) := co{£ : 3(t t , x t ) A (t, s) : (7) 
h(ti,Xi) > Vi, d x h(ti,Xi) -> £}. 

Theorem 3.1: Let (x*,u*) be a strong local minimum for 
problem (P). Assume that f and L satisfy Al, /i satisfies 
A3 and f/iaf A2 as we/Z as f/ze /3as/c assumptions B1-B3 
hold. Then there exist an absolutely continuous function 
p, an integrable function 7, a non-negative measure fi G 
C® ([a, 6]; K), ana" a scalar Xq smc/j f«af conditions (i)— 
(vi) of Proposition\l\hold with d x h as in replacing d x h 
and where q is as defined in ([SJ. 

For the convex case see [2] for preliminary results for 
problems with additional mixed state control constraints. 
Removal of convexity will the be focus of future work. 

The above theorem adapts easily when we assume (x*, it*) 
to be a weak local minimum instead of a strong local 
minimum (see discussion above). It is sufficient to replace 
U(t) by U{t)f]B £ (u*{t)). 

Theorem I3.ll can now be extended to deal with a local 
W 1 ' 1 -minimum for (P). 

Theorem 3.2: Let (x*,u*) be merely a local W 1 ' 1 - 
minimum for problem (P). Then the conclusions of Theorem 
UJ\ hold. 

We omit the proof of this Theorem here since it can be 
easily obtained mimicking what is done in [17]. 

C. Linear Convex Problems 

The distinction between Theorem 13.11 and classical non- 
smooth maximum principle (see [17]) is well illustrated by 
an example provided in [9]. We recover such example here 



showing that Theorem 13. II can eliminate processes whereas 
the classical nonsmooth maximum principle cannot. 

Example: Consider the problem on the interval [0, 1]: 



Minimize 



(wi\x — ui\ + w 2 \x — U2I + x)dt 



(L) 



subject to 

x(t) = Awx{t)u\(t) + iw 2 (t)u 2 (t) for a. e. t, 

x(t) ^ -1 for all t, 

ui(t), u 2 (t) G [-1, 1] for a. e. t, 

(w 1 (t),w 2 {t)) G W for a. e. t, 

x(0) = 



where 



W := {{wi,w 2 ) G 



Wi, w 2 ^ 0, wi + w 2 = 1}. 



The process (x*, u\, u 2 , w*, w 2 ) := (0,0,0,1,0) is an 
admissible process with cost and along the trajectory 
the state constraint is inactive. It is easy to see that 
the classical nonsmooth maximum principle holds when 
we take all the multipliers but Ao = 1. However, 
(x* , u\, u 2 , w*, w 2 ) is not optimal. In fact, if we consider 
the process (x, m, u 2 *, w\, w 2 ) = (— 4cri, — a, 0, 1, 0), with 
a G (0,1/4), we see that this process has cost — 3/4a. 
Now let us apply Theorem 13.11 to our problem for the 
process (x* , u*, u 2 , wl , w 2 ). Since the state constraint is 
inactive, we deduce that measure /i is null. Considering 
the Euler Lagrange equation in (ii) of Theorem 13.11 we 
deduce that there should exists an absolutely continuous 
function p and a scalar Ao ^ satisfying (i) of Theorem 
XTJand such that p(l) = 0, -p(t) = -A (l + e(t)) and 
= 4p(t) + X e(t) where e(t) takes values in [—1,10. A 
simple analysis will convince the reader that this situation 
is impossible. This means that Theorem 13.11 does not hold 
excluding (x* ,u\,u 2 ,wl,w 2 ) as a minimum. ■ 



Consider the problem 



Minimize l(x(a), x(b)) 



L(t,x(t),u{t))dt 



(LC) 



subject to 

x(t) = A(t)x(t) + B(t)u(i) for a. eJe [a, b], 
D(t)x(t) ^ for all t G [a, 6], 
u(t) G U(t) for a. e. t G [a, b], 
(x(a),x(b)) G E 

where E is convex, the multifunction U is convex valued, the 
functions I and (x,u) —> L(t,x,u) are convex, the function 
A : [0, 1] R nx " is integrable, the function B : [0, 1] 
R nxk is measurable, and the function D : [0,1] ->• R lxn 
is continuous. Then (LC) is what we refer to as a linear 
convex problem with state constraints. 

Theorem 13.11 (and of course Theorem 13.2) keeps the sig- 
nificant feature of being a sufficient condition of optimality 
in the normal form for problem (LC). This follows directly 
from the observation that the proof of Proposition 4. 1 in [9] 

2 The function e appears from the subdifferential of the cost which is 
clearly nonsmooth due to the presence of the modulus. 



proves our claim. No adaptation is required in this case. For 
completeness we state such proposition here. 

We say that a process (x*, w*) is a normal extremal if it 
satisfies the conclusions of Theorem 13. II with Aq = 1. 



(Q) 



Proposition 2: ([9]) If the process (x*,u*) is a normal 
extremal for problem (LC), then it is a minimum. 

Let us return to our previous example. Problem (L) is what 
we call a linear convex problem. It is now obvious that the 
process (x*, u\, it^, wl, w^) := (0,0,0,1,0) does not satisfy 
the conclusions of Theorem 13.11 if it did, then it would be a 
minimum as asserted by Proposition [2] and it is not. 

IV. PROOFS OF THE MAIN RESULTS 

Since our proofs are based on those in [9] and [10] we 
we only give a brief sketch of them, refereing the reader to 
the appropriate literature for details. 

All the results are proved assuming that L = 0. The case 
of L 7^ is treated by a standard and well known technique. 

A. Sketch of the Proof of Proposition Q] 

• First the validity of the Proposition is established for 
the simpler problem 

Minimize l(x(b)) 
subject to 

x(t) = f(t, x(t),u(t)) a.ei G [a, b] 
u(t) G U(t) a.ei G [a, b] 
h(t, x(t)) ^ for all t G [a, 6] 
(x(a),x(b)) G {x a } x E b . 

Problem (Q) is a special case of (P) in which E = 
{x a } x E b and l(x a ,x b ) = l(x b ). 
Our proof consists of the following steps 
Ql Define a sequence of problems penalizing the state- 
constraint violation. The sequence of problems is 

Minimize l(x(b)) + i f h + (t,x(t)) dt 

J a 

subject to 

x(t) = f(t, x(t),u(t)) a.e. t G [a, b] 

(x(a),x(b)) G {x a } x E b , 

where h + (t,x) := max{0, h(t, x)}. 
Q2 Assume that [IH] lim inf{<5 t } = inf{Q}. 
Q3 Set W to be the set of measurable functions u : 
[a, b] -> R fc , u(t) G U(t) a.e. such that a solution 
of the differential equation x(t) = f(t,x(t),u(t)), 
for almost every t G [a,b], with x(t) G x*(t) + 
eM for all t G [a, b] and x(a) = x a and x(b) G 
E b . We provide W with the L 1 metric defined by 
A(it, v) :=\\ u — v and set 

Ji(u) := l(x(b)) + i [ h + (t, x(t)) dt. 



(Qi) 



Then (W, A) is a complete metric space in which 
the functional L : W — s- K is continuous. 



Q4 Apply Ekeland's theorem to the sequence of prob- 
lems of the form 



(Oi 



Minimize Ji(u) 
subject to u G W 

which are closely related to (Qi). 
The conclusion of application of Ekeland's theorem 
shows that (xi,Ui) solves the following optimal 
control problem: 



Minimize l(x(b)) + i / h + (t, x(t)) dt+ 



Sfaja \u(t)- Ui (t)\ dt 

subject to 

x(t) = f(t,x(t),u(t)) a.e. t G [a,b] 
u(t) G U(t) a.e. t € [a, b] 
x(a) = x a 
x{b) G E b . 

The fact that Si — > allows us to prove that 

m converges strongly to u* and Xi converges 

uniformly to x* . 
Q6 Rewriting these conditions and taking limits as in 

[9] we get the required conclusions. 
Q7 Finally we show that C implies IH. 
The remaining of the proof has three stages. We first 
extend Proposition Q] to problems where x(a) G E a , 
and E a is a closed set. This is done following the lines 
in the end of the proof of Theorem 3.1 in [16]. 
Next we consider the case when the cost is I = 
l(x(a),x(b)). This is done using the technique in Step 
2 of section 6 in [11]. And finally, following again 
the approach in section 6 in [11], we derive necessary 
conditions when (x(a),x(b)) G E, completing the 
proof. 

In order to proof our result, an important piece of analysis 
added to the proof of Theorem 3.1 in [9] concerns the 
Weierstrass condition (iii) of Proposition Q] The information 
extracted while taking limits allow us to do that without that 
much ado. 



B. Sketch of the Proof of Theorem 13.71 

We now proceed to prove our main Theorem 13. II We recall 
that under our hypotheses both Q and © hold and that the 
set f(t,x,U(i)) is compact. 

Our proof consists of several steps. We first consider the 
following 'minimax' optimal control problem where the state 
constraint functional max h(t,x(t)) appears in the cost. 

t£[a,b] 

Minimize l(x(a), x(b), max h(t,x(t))) 

t€[a,b] 

over x G W 1 ' 1 and measurable u satisfying 

(R) { ±(t) = f(t,x(t),u(t)) a.e. t G [a,b] 
u(t) G U(t) a.e. t G [a, b] 

(x(a),x(b)) G E a x W\ 

where T: MP xM n xM -> R is a given function and E a C M" 
is a given closed set. We observe that (R) is the optimal 
control problem with free endpoint constraints. 



We impose here the following additional assumption A4, 
the necessity of which for the forthcoming development of 
our proof will become clear soon. 

A4 The integrable function I is Lipschitz continuous on a 
neighbourhood of 

(x*(a),x*(b), max h(t,x*(t))) 
te[a,b] 

and I is monotone in the z variable, in the sense that 
z' ^ z implies l(y,x,z') > l(y,x,z), for all (y, x) G 
E" x K n . 

The following proposition is a straightforward adaptation 
of Proposition 9.5.4 of [17]. 

Proposition 3: Let (x* , u*) be a strong local minimum for 
problem (R). Assume the basic hypotheses, Al, A2 and A3 
and the data for the problem (R) satisfies the hypothesis 
A4. Then there exist an absolutely continuous function p : 
[a, 6] — > M n , an integrable function 7 : [a, b] — > R", a non- 
negative measure fi G C®([a, 6];R), and a scalar Xq ^ 
such that 

^{[o,6]} + |1p|| oo + A >0 ) (8) 
(-p(t),0) G dC u {q(t),f(t,x*(t),u*(t))) (9) 
-{°}x^£(t) («*(*)) a.e. 

(10) 



(p(a),-q(b), v(ds))£ 

J[a,b) 

N£ a (x*(a)) x {0,0} + 
X dl(x* (a) , x* (6), max te[a ^] h(t, x* (t)) 

7(t) G Bh(t,x*(t)) fj,-a.e., 



(ID 



V u G U(t), (12) 
(q(t),f(t,x*{t),u)) < (q{t)J{t 7 x*(t),u*{t))) a.e. , 

supp{/4 c (13) 
{t G [a, b] : h(t,x*(t)) = max se[a ^] h(s,x*(s))} , 

where q is defined as in ©. 



We now turn to the derivation of Theorem 13.11 Consider 
the set 

V := {(x, u, e) : (x,u) satisfies x(t) = f(t,x(t),u(t)), 

u(t) G U(t) a.e., e G R n , (x(a), e) G C 
and ||x — x*||l=o ^ e} 

(14) 

and let dy : V x V — > R be a function defined by 

d v ((x, u, e), (x',u',e')) = (15) 
\x(a) - x'(a)\ +\e- e'\ + J* \u(t) - u'(t)\dt 

For all i, we choose gj J, and define the function 

k(x,y,x',y',z) := 
m&x{l(x, y) - l(x*(a),x*(b)) + ej, z, \x' - y'\}. 



Then dy defines a metric on the set V and (V,dv) is a 
complete metric space such that 

• If (xi,Ui,ei) — > (x,u,e) in the metric space (V,dy), 

then \\xi — x\\l°° —r 0, 
> The function 

(x, u, e) — > li(x(a), e, x(b), e, max h(t,x(t))) 

te[a,b] 

is continuous on (V,dy)- 
We now consider the following optimization problem 

Minimize {li(x(a), e, x(b), e, max t6 [ aj& ] h(t, x(t))) : 
(x, u, e) £ V}. 

We observe that 

lAx*{a), x*(b), x*(b), x*(b), max h(t, x*(t))) = ef. 

t£[a,b] 

Since li is non-negative valued, it follows that 
(x* , u* , x* (b)) is an e^-minimizer for the above minimiza- 
tion problem. According to Ekeland's Theorem there exists 
a sequence {(xi, Ui, ej)} in V such that for each i, we have 

k{xi{a),ei,Xi(b),ei,Taax te [ a ^h(t,x t (t))) ^ (16) 
k(x(a), e, e, max te|a ^] x(i))) + 
Eid v ((x,u,e), (xi,Ui,ei)) 

for all (x, u, e) G y and we also have 

d v ((xi,Ui,ei), (x*,u*,x*(b))) ^ (17) 

Thus the condition (fTTl i implies that e.; — > and Ui — > 

u* in the L 1 norm. By using subsequence extraction, we 
conclude that ui — > u* a.e. and Xi — > x* uniformly. 

Now we define the arc yi = e^. Accordingly we get — > 
x*{b) uniformly. From the minimization property (IT6l . we 
say that (xi,yi,Wi = 0,u.i) is a strong local minimum for 
the optimal control problem 

Minimize 

k(x(a),y(a), x(b), y(b),m&x te[ayb] h(t, x(t))) 
+ Ei[\x(a) - Xi(a)\ + \y(a) - yi(a)\ + w(b)} 
(~R\ J over x ->y-> w e W 1 ' 1 and measurable u satisfying 

[Ui) \ x(t) = f(t,x(t)Mt)im = o, 

w(t) = \u(t) - Ui(t)\ a.e., 
u(t) £ U(t) a.e., 
k {x(a),y(a),w{a)) £ C x {0}. 

Now we observe that the cost function of (Ri) satisfies 
all the assumptions of the Proposition [3] and thus this is an 
example of optimal control problem where the special case of 
maximum principle of Proposition [3] applies. Rewriting the 
conclusions of Proposition [3] and taking limits we obtained 
the required conditions. The remain of the proof follows 
closely the approach in [10]. 



V. CONCLUSIONS 

In this work we derive a variant nonsmooth maximum 
principle for state constrained problems. The novelty of this 
work is that our results are also sufficient conditions of 
optimality for the normal linear-convex problems. The result 
presented in the main theorem is quite distinct to previous 
work in the literature since for state constrained problems, we 
add the Weierstrass conditions to adjoint inclusions using the 
joint subdifferentials with respect to the state and the control. 
The illustrated example presented in the paper justifies our 
results. 
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